Semi-Supervised Learning via New Deep Network Inversion

نویسندگان

  • Randall Balestriero
  • Vincent Roger
  • Hervé Glotin
  • Richard G. Baraniuk
چکیده

We exploit a recently derived inversion scheme for arbitrary deep neural networks to develop a new semi-supervised learning framework that applies to a wide range of systems and problems. The approach outperforms current state-of-the-art methods on MNIST reaching 99.14% of test set accuracy while using 5 labeled examples per class. Experiments with one-dimensional signals highlight the generality of the method. Importantly, our approach is simple, efficient, and requires no change in the deep network architecture. 1 ar X iv :1 71 1. 04 31 3v 1 [ st at .M L ] 1 2 N ov 2 01 7

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Semi-Supervised Learning Enabled by Multiscale Deep Neural Network Inversion

Deep Neural Networks (DNNs) provide state-of-the-art solutions in several difficult machine perceptual tasks. However, their performance relies on the availability of a large set of labeled training data, which limits the breadth of their applicability. Hence, there is a need for new semisupervised learning methods for DNNs that can leverage both (a small amount of) labeled and unlabeled traini...

متن کامل

Semi-supervised Learning for Convolutional Neural Networks via Online Graph Construction

The recent promising achievements of deep learning rely on the large amount of labeled data. Considering the abundance of data on the web, most of them do not have labels at all. Therefore, it is important to improve generalization performance using unlabeled data on supervised tasks with few labeled instances. In this work, we revisit graph-based semi-supervised learning algorithms and propose...

متن کامل

Semi-Supervised Speaker Adaptation for In-Vehicle Speech Recognition with Deep Neural Networks

In this paper, we present a new i-vector based speaker adaptation method for automatic speech recognition with deep neural networks, focusing on in-vehicle scenarios. Our proposed method is, rather than augmenting i-vectors to acoustic feature vectors to form concatenated input vectors for adapting neural network acoustic model parameters, is to perform featurespace transformation with smaller ...

متن کامل

A Probabilistic Framework for Deep Learning

We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate that max-sum inference in the DRMM yields an algorithm that exactly reproduces the operations in deep convolutional neural networks (DCNs), providing a first ...

متن کامل

Deep Learning Neural Network with Semi supervised Segmentation for Predicting Retinal and Cancer Cell Diseased

In medical field, diagnosis of diseases competently carried out by using the image processing. So that to retrieve the relevant data from the amalgamation of resulting image is too difficult. Here the segmentation done by semi supervised learning then the result is tuned by using Deep Learning Neural Network. Higher tuning of results will leads to efficient detection of disease. The experiment ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1711.04313  شماره 

صفحات  -

تاریخ انتشار 2017